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VIDEO DISPLAY SYSTEM HAVING BY-THE-LINE AND BY-THE-PIXEL MODIFICAITON 



BACKGROUND 

2^ Field of the Invention 

The invention relates generally to digital image 
processing and the display of digitally generated 
10 images. 

The invention relates more specifically to the 
problem of creating raster-based, high- resolution 
animated images in real time, where the mechanism for 
generating each raster line is modifiable on a by-the- 
pixel basis, or on a by- the- line basis, or on a by-a- 
group of lines basis. 



15 



25 



^ Cross Referenpp to Related App i i . cati r>ng 

This application is related to the following co- 
pending applications: 
^° PCT Patent Application Serial No. 

PCT/US92/09342, entitled RESOLUTION ENHANCEMENT FOR 
VIDEO DISPLAY USING MULTI-LINE INTERPOLATION, by 
inventors Mical et al . , filed November 2, 1992, 
[Attorney Docket No. MDI03050,] and also to U.S. Patent 
Application Serial No. 07/970,287. bearing the same 
title, same inventors and also filed November 2, 1992; 

(b) PCT- Patent Application Serial No. 
PCT/US92/09349, entitled AUDIO/VIDEO COMPUTER 
ARCHITECTURE, by inventors Mical et al . , filed November 
2, 1992, [Attorney Docket No. MDI04222 , ] and also to 
U.S. Patent Application Serial No. " 07/970 , 308 , bearing 
the same title, same inventors and also filed November 
2, 1992; 

(c) PCT Patent Application Serial No. 
35. . .PCT/US92/09350, entitled METHOD FOR CONTROLLING A 
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SPRYTE RENDERING PROCESSOR, by inventors Mical et al . , 
filed November 2, 1992, [Attorney Docket No. MDIO3040,] 
and also to U.S. Patent Application Serial No. 
07/970,278, bearing the same title, same inventors and 
5 also filed November 2, 1992; 

(d) PCT Patent Application Serial No. 
PCT/US92/09462, entitled SPRYTE RENDERING SYSTEM WITH 
IMPROVED CORNER CALCULATING ENGINE AND IMPROVED 
POLYGON- PAINT ENGINE, by inventors Needle et al . , filed 

10 November 2, 1992, [Attorney Docket No. MDI04232,] and 
also to U.S. Patent Application Serial No. 07/970,289, 
bearing the same title, same inventors and also filed 

November 2, 1992; 

(e) PCT Patent Application Serial No. 
15 PCT/US92/09460, entitled METHOD AND APPARATUS FOR 

UPDATING A CLUT DURING HORIZONTAL BLANKING, by 
inventors Mical et al . , filed November 2, 1992, 
[Attorney Docket No. MDIO4250,] and also to U.S. Patent 
Application Serial No. 07/969,994, bearing the same 
20 title, same inventors and also filed November 2, 1992; 

(f) PCT Patent Application Serial No. 
PCT/US92/09467, entitled IMPROVED METHOD AND APPARATUS 
FOR PROCESSING IMAGE DATA, by inventors Mical et al . , 
filed November 2, 1992, [Attorney Docket No. MDIO4230, ] 

25 and also to U.S. Patent Application Serial No. 
07/970,083, bearing the same title, same inventors and 
also filed November 2, 1992; 

(g) PCT Patent Application Serial No. 
PCT/US94/12521, entitled DISPLAY LIST MANAGEMENT 

30 MECHANISM FOR REAL-TIME CONTROL OF BY -THE -LINE 
MODIFIABLE VIDEO DISPLAY SYSTEM, by inventors Robert 
Joseph Mical et al . , filed November 1, 1994, [Attorney 
Docket No. MDI04255,] and also to U.S. Patent 
Application Serial No. 08/146,505, bearing the same 

35 title, same inventors and filed November 1, 1993; and 



BNSDOCID <WO 963e037Al_l_> 



wo 96/36037 



PCT/US96/06438 



- 3 - 

(h) U.S. Patent Application Serial "No. 

08/311,192 entitled REAL TIME DECOMPRESSION AND 
POST-DECOMPRESS MANIPULATION OF COMPRESSED FULL MOTION 
VIDEO, by inventors Steve C. Wasserman et al . , filed 
5 September 23, 1994 [Attorney Docket No. MDIO4370] . 

The related patent applications are all commonly 
assigned with the present application and are all 
incorporated herein by reference in their entirety. 

The present application is to be considered a 
10 continuation-in-part of at least the above cited U.S. 
Patent Application Serial No. 08/146,505, entitled 
DISPLAY LIST MANAGEMENT MECHANISM FOR REAL-TIME CONTROL 
OF BY-THE-LINE MODIFIABLE VIDEO DISPLAY SYSTEM, by 
inventors Robert Joseph Mical et al., filed November 1, 
15 1993, [Attorney Docket No. MDI04255] . 

3_= Description of the Related Art 

In recent years, the presentation and pre- 
presentation processing of visual imagery has shifted 
from what was primarily an analog electronic format to 
20 an essentially digital format. 

Unique problems come to play in the digital 
processing of image data and the display of such image 
data. 

The more prominent problems include providing 
25 adequate storage capacity for digital image data and 
maintaining acceptable data throughput rates while 
using hardware of relatively low cost. In addition, 
there is the problem of creating a sense of realism in 
digitally generated imagery, particularly in animated 
30 forms of such imagery. 

Visual realism for imagery generated by digital 
video game systems, by simulators and the like can be 
enhanced by providing special effects such as, but not 
limited to, creating moving sprites, making real-time 
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Changes in the shadowing and/or highlighting of various 
objects, smoothing or sharpening the contours of 
various objects at different times, and so forth. 

Visual realism can be further enhanced by 
5 projecting 3-dimensional object definitions onto a 
2 -dimensional display screen and rotating, scaling or 
otherwise manipulating the 3 -dimensional object 
definitions in real time prior to their projection onto 
the 2 -dimensional display screen. 
10 Visual realism can be additionally enhanced by 

increasing the apparent resolution of a displayed image 
so that it has a smooth photography- like quality rather 
than a grainy disjoined- blocks appearance of the type 
found in low- resolution computer-produced graphics of 

15 earlier years. 

Visual realism can be even further enhanced by 
increasing the total number of different colors and/or 
shades in each displayed frame of an image so that, in 
regions where colors and/or shades are to change in a 
20 smooth continuum by subtle degrees of hue/intensity, 
the observer perceives such a smooth photography- like 
variation of hue/intensity rather than a stark and 
grainy jump from one discrete color/shade to another. 

Although bit -mapped computer images originate as 
25 a matrix of discrete lit or unlit pixels, the hiiman eye 
can be fooled into perceiving an image having the 
desired photography- like continuity if the displayed 
matrix of independently- shaded (and/pr independently 
colored) pixels has dimensions of approximately 500-by- 
30 500 pixels or better at the point of display and a 
large variety of colors and/or shades on the order of 
roughly 24 bits-per-pixel or better. 

The VGA graphics standard, which is used in many 
present-day low-cost computer systems, approximates 
35 this effect with a display matrix having dimensions of 
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640-by-480 pixels. However," conventional low-cost VGA 
graphic systems suffer from a limited per- frame palette 
of available colors and/or shades. 

Standard NTSC broadcast television systems also 
5 approximate the continuity mimicking effect by using 
interlaced fields with 525 lines per pair of fields and 
a horizontal scan bandwidth (analog) that is equivalent 
to approximately 780 RGB colored dots per line 
(approximately 480-by-640 active pixels) . 
10 More advanced graphic display standards such as 

Super-VGA and High Definition Television (HDTV) rely on 
much higher resolutions, 1024 -by- 786 pixels per frame, 
for example. 

It is expected that display standards will emerge 
15 in the future with yet higher resolution numbers (e.g., 
2048-by-2048) . It is expected that the number of bits 
per displayed pixel will similarly increase in the 
future . 

With each increase in frame resolution (pixels 
per frame) and each increase in the number of colors 
and/or shades that are available per display frame, the 
problem of providing adequate storage capacity for the 
corresponding digital image data becomes more acute . 
The problem of providing sufficient data processing 
25 throughput rates also becomes more acute. This is 
particularly so if an additional constraint is imposed 
of keeping hardware costs within an acceptable price 
versus performance range. 

A display with 640-by-480 independent pixels 
30 (307,200 pixels total) calls for a conventional frame 
buffer having at least 19 address bits as its input or 
a corresponding 2^^ independently- addressable data 
words ( = 512K words) . Each data word in such a frame 
buffer stores a binary code representing the shading 
35 and/or color of an individual pixel. Each doubling of 
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display resolution, say from 640-by-480 pixels to 1280- 
by-960 pixels, calls for a four-fold increase in the 
storage capacity of the frame buffer. Each doubling of 
per-pixel color/shade variation, say from 8 bits-per- 
5 pixel to IS bits -per-pixel. calls for an additional 
two- fold increase in storage capacity. 

This means that a system designed according to 
conventional techniques to initially render an at- 
display image of 640-by-480 independent pixels per 
10 frame. at 8 bits-per-pixel , would conventionally 
require an eight -fold increase of memory capacity, from 
512K bytes to 4MB (four Megabytes) as a result of 
doubling each of the number of pixels per row, number 
of pixels per column and the number of bits-per-pixel. 

15 In cases where parts or all of the resultant 

l280-by-960 display field have to be modified in real- 
time (to create a sense of animation) , the eight -fold 
increase of storage capacity calls for a corresponding 
eight- fold increase in data processing bandwidth (image 
2 0 bits processed per second) as compared to what was 
needed for processing the original, 8 bits-per-pixel, 
640-by-480 pixels frame. 

At some point, the benefit versus cost ratio 
associated with such an approach has to be questioned. 
25 Is it necessary to continuously increase storage 
capacity and to forever seek faster data processing 
speeds in order to obtain improvements in apparent 
performance for the end user? 

Perhaps a given increase in performance is not 
30 worth the corresponding increase in system cost if the 
conventional approach is followed of increasing storage 
capacity and providing a corresponding increase in data 
processing speed. 
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Ps^^^ps it is possible to create a perception of 
improved performance without suffering a concomitant 
burden of significantly higher system cost. 

Such an objective can be realized by using a 
5 High-performance, Inexpensive, Image -Rendering system 
(HI-IR system) such as disclosed in the above cited set 
of co-related patent applications. 

Part of the low- cost and high-performance (high 
performance/price ratio) of the earlier- disclosed HI-IR 
10 system is owed to the use, in a display- defining path 
of the system, of Color Lookup Tables (CLUT's) whose 
color-mapping functions are modifiable on a by-the-line 
basis and even on a by-the-pixel basis. 

Another part of the high perf ormance/price ratio 
15 of the HI-IR system is owed to the use, in the display - 
defining path of the system, of a subposition-weighted 
Interpolator whose subposition weights are modifiable 
on a by-the-pixel basis and whose modes of operation 
(horizontal -interpolation on/off and vertical- interpo- 
20 lation on/off) are modifiable on a by-the-line or by- 
the- frame basis. 

Yet another part of the low- cost and high- 
performance of the HI-IR system is owed to the use, in 
a bitmap -defining portion of the system, of a unique 
25 set of one or more ^spryte' rendering engines (also 
called eel-animating engines) for executing a list of 
bitmap modification instructions stored in a queue. 

A description of such a spryte- generating 
mechanism may be found in the above cited PCT Patent 
30 Application Serial No. PCT/US92/09350 , entitled METHOD 
FOR CONTROLLING- A SPRYTE RENDERING PROCESSOR, and also 
in PCT Patent Application Serial No. PCT/US92/09462 , 
entitled SPRYTE RENDERING SYSTEM WITH IMPROVED CORNER 
CALCULATING ENGINE AND IMPROVED POLYGON - PAINT ENGINE, 
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Yet a further part of the high performance/price 
ratio of the HI-IR system is owed to the use, in an 
application program interface portion of the system, of 
a flexible yet robust list -based control of the post- 
5 frame buffer 'display path' segments of the system. 

A description of such a list -based mechanism may 
be found in the above cited PCT Patent Application 
Serial No. PCT/US9 4/12 521, entitled DISPLAY LIST 
MANAGEMENT MECHANISM FOR REAL-TIME CONTROL OF BY -THE - 
10 LINE MODIFIABLE VIDEO DISPLAY SYSTEM. 

More recently, the industry has sought ways to 
add even more realism to the rendered images that 
originate from computer- generated image definitions. 

Compound systems are being proposed that have 
15 both real-time 2 -dimensional object manipulation means 
(sprite manipulation means) and real-time 3 -dimensional 
object manipulation means as well as other means that 
contend for access to system memory (e.g., system CPU's 
and real-time sound generating modules) . 
20 The compound nature of such systems places a 

strain on system memory to deliver (or store) time- 
critical data to (or from) devices or modules that need 
to operate on a real-time basis. An example of time- 
critical data is video data that may be needed on a 
25 real-time basis, within the download time window of a 
horizontal raster line for example, in order to provide 
real-time rendering of an interactive game image or an 
interactive simulator image. 

The proposed compound systems have added 
3 0 functionalities that further strain the throughput 
capabilities (data bandwidth) of the memory- access 
management subsystem and complicate the tasks of the 
memory- access management subsystem. The memory- access 
management stibsystem now needs to arbitrate among a 
35 larger nvimber of contenders for memo3ry access. 
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The added functionalities of the proposed 
compound systems additionally strain the throughput 
capabilities and complicate the tasks of any system 
CPU's that have to supervise the activities of the 
5 image manipulation means on a real-time basis. (The 
term "CPU's" refers here to a general -purpose data 
processing subsystem which may be implemented either in 
a centralized unit format, as for example a single 
truly -central processing unit; or which may be 
10 implemented in a plural units format, such as in a 
parallel processing system. ) 

A system architecture is needed for reducing 
contention among plural potential requesters for system 
memory access . 

A system architecture is needed for reducing 
contention by plural software modules for access to the 
limited resources of system CPU's. 

A methodology is needed for simultaneously 
satisfying the needs of multiple, time- critical 
20 processes such as those of a real-time video display 
subsystem and those of a real-time animation subsystem. 

SUMMARY OF THE TNVENTION 
The above-mentioned problems are overcome in 
accordance with the invention by providing a graphics 
25 system that has a mult i -port, memory subsystem storing 
video display control lists (VDL's) and a real-time 
programmably- configurable video - post-processor (VPP) 
coupled to the memory subsystem and responsive to the 
stored VDL' s . 

30 A video post -processor (VPP) in accordance with 

the invention reduces the load on system memory and on 
the system CPU's. Such a VPP periodically fetches 
render- control lists (VDL's) and image data from the 
memory subsystem on a' block basis and processes the 
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fetched information without requiring continuous real- 
time intervention by system CPU's, This frees the 
system CPU (or CPU's) for managing other time-critical 
tasks of the graphics system. 
5 One embodiment of a video post -processor (VPP) in 

accordance with the invention includes an addressable 
register set that is programmable by one or both of a 
system CPU and a memory- resident control- list . 

One embodiment of a graphics system in accordance 
10 with the invention comprises an Image -Enhancing And 
Rendering Subsystem (I -EARS) that includes the video 
post -processor (VPP) . The programmable register set of 
the VPP defines primitive configurations for the VPP 
and for remaining portions of the I-EARS. The 
15 register- controlled primitives of the I-E7^S include 
those that are modifiable on a per-pixel (PP) basis, 
those that are modifiable on a per-scanline (PS) basis, 
and those that are modifiable on a per- field (PF) 
basis . 

2 0 The one embodiment of the video post -processor 

(VPP) further includes a FIFO means for fetching 
sufficient pixel -defining data on a timely basis from 
a memory subsystem so as to allow the configurable 
image -enhancing and rendering subsystem (I-EARS) to 
25 continuously supply video signals on a timely basis to 
a real-time video display means. 

Each pixel -defining entity that is stored within 
the VPP FIFO means can include a so-called D-bit that 
may be used for modifying operations of the I-EARS on 
30 a per-pixel basis. 

A variety of windowing effects can be provided 
for by modulating the D-bit and enabling it to define 
on a by-the-pixel basis whether various options within 
the image -enhancing and rendering subsystem (I-EARS) 
35 are to be enabled, including but not limited to: 
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ea) horizontal interpolation, (b) vertical 
interpolation, (c) horizontal filtering, (d) ordered 
dithering, and (e) RGB-to-YUV conversion. 

These and other features of the graphics system 
will become clearer by referring to the below detailed 
description. 



BRIEF DE SCRIPTTON OF THR DRAWTTJn.q 
The below detailed description makes reference to 
the accompanying drawings, in which: 
10 FIGIIRE 1 is a block diagram of a High- 

performance, Inexpensive, Image -Rendering system (HI-IR 
system) in accordance with the invention that includes 
a programmably- configurable Video Post Processor (VPP) ; 

FIGURE 2 is a block diagram showing more details 
15 of a video post -processor (VPP) in accordance with the 
invention; 

FIGURE 3A shows three different formats according 
to which frame buffer data may be stored in system 
memory; 

20 FIGURE 3B shows the FIFO data format for split 

mode and the FIFO input and output sections; 

FIGURE 4A illustrates post -FIFO manipulation of 
video data by plural color look-up tables (GLUT'S), by 
a CLXJT-bypass circuit, and by a blue-pen bit 
25 substitution circuit responsive to the D-bit; and 

FIGURE 4B illustrates post -GLUT processing of 
video data by an interpolator circuit. 



30 



DETAILED DRSCRIPTTQN 

Referring to Fig. 1, a block diagram of an image 
processing and display system 100 in accordance with 
the invention is shown. 

A key feature of system 100 is that it is 
relatively low in cost and yet it provides mechanisms 
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for handling complex image scenes in real time and 
displaying them such that they appear to have 
relatively high resolution and a wide variety of colors 
and/or shades per displayed frame. 

This feature is made possible by including within 
the system 100, an Image -Enhancing And Rendering 
Subsystem (I-EARS) comprised of: a video post -processor 
(VPP) 150, a digital encoder (DENC) 160, and a 
plurality of digital- to- analog converters (DAC's) 170. 

The image- enhancing and rendering subsystem 
(I-EARS) 150-160-170 may be formed within one 
integrated circuit (IC) chip or it may be distributed 
across a few IC chips. In one particular embodiment, 
elements 150, 160 and 170 are implemented within one 
15 integrated circuit (IC) chip together with elements 
115, 120, 121, 122, 123, 124, 145 and 147 of Fig. 1. 
This one IC chip is referred to herein as the » I-EARS 
chip' - 

Within the I-EARS group of elements, 150-160-170, 
20 there is provided a set of user-programmable Color 
Lookup Table modules (CLUT's) 231, 232, and 235 as seen 
in the more-detailed view of Fig. 2. Also provided, 
are a hardwired pseudo- linear CLUT circuit 233 which 
can be programmably substituted for one of CLUT's 231- 
25 232 on a by-the-pixel basis, and a user-programmable 
resolution- enhancing interpolator 250 as further seen 
in Fig. 2. 

(Note that elements referenced by numerals in the 
'100' nxunber series generally appear in Fig. 1, those 
referenced by numerals in the '200' number series 
generally appear in Fig. 2, and so forth.) 

The operations and importance of the components 
within the image- enhancing and rendering subsystem 
(I-EARS) 150-160-170 may be better appreciated by first 
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considering the video processing operations of system 
100 in an overall sense. 

Except as otherwise stated, all or most parts of 
system 100 are implemented on a single printed circuit 
board 99 and the circuit components are defined within 
one or a plurality of integrated circuit (IC) chips 
mounted to the board 99. Except as otherwise stated, 
all or most of the circuitry is preferably implemented 
in CMOS (complementary metal -oxide-semiconductor) 
technology using 0.5 micron or narrower line widths. 
An off-board power supply (not shown) delivers 
electrical power to the board 99. 

System 100 includes a real-time video display 
unit (VDU) 18 0 such as an NTSC standard television 
15 monitor or a PAL standard television monitor or a 640- 
by-480 VGA computer monitor or a higher- resolution 
monitor. The VDU 180 is used for displaying high- 
resolution animated images 185 to a system user 190. 

The video display unit (VDU) 180 may also include 
audio output means (not shown) for simultaneously 
producing and supplying corresponding multi -phonic or 
monophonic sound to the system user 190. 
Alternatively, such audio output means (not shown) is 
provided separately from the VDU. Although not shown, 
25 it is understood that system 100 may include 
appropriate audio signal generating circuitry for 
driving the audio output means (not shown) and that the 
audio signal generating circuitry (not shown) may 
include digital audio synthesis circuitry for creating 
effects that give the impression of 3 -dimensional sound 
(echoes, Doppler effect and so forth). 

The image -enhancing and rendering subsystem 
(I-EARS) 150-160-170 drives the video display unit 
(VDU) 180. A system user 190 observes the displayed 
imagery 185 and hears any accompanying audio by way of 
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audio-visual coupling path 191- An interactive 
response mechanism 195 is provided in the form for 
exair^le of a joystick and/ or a pad of push-buttons for 
allowing the system user 190 to feedback to the 
hardware (e.g., CPU 110) his or her real-time responses 
to the perceived audiovisual show by way of control 
port interface 104. 

The image- enhancing and rendering subsystem 
(I-EARS) 150-160-170 has a pipelined structure that 
moves data signals synchronously from an upstream 
portion to a downstream portion. The downstream 
portion of the I-EARS 150-160-170 is clocked by a video 
clock generator (vidCLK) 167 that operates according to 
pre-specif ied pixel and control rates of the VDU 180. 
15 In one embodiment, the vidCLK rate is approximately 
12.5 to 15 MHz. 

The digital encoder (DENC) 160 includes a timing 
section that generates frame synchronization signals 
such as vertical synch pulses (V- synch) and horizontal 
20 synch pulses (H- synch) in synchronism with the vidCLK 
167. 

The upstream portion of the I-EARS 150-160-170 is 
clocked by a system clock generator (sysCLK) 117 that 
operates according to a pre-specif ied system rate. The 
25 system rate is typically different from the vidCLK 
rate. In one embodiment, the sysCLK rate is 

approximately 66 MHz. The sysCLK 117 is used for 
driving other portions of system 100 such as the 
illustrated CPU 110, eel -engines 145, and triangle 

30 engine 147. 

System 100 further includes a real-time 
audiovisual -data processing subsystem comprised of: a 
control port interface 104, a basic I/O interface 
module 105, a general purpose central -processing unit 

35 (CPU) 110, a multi-port memory 130-131, a plurality of 
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2 -dimensional image manipulating engines (eel -engines) 
145, and a 3 -dimensional image manipulating engine 
(triangle engine) 147. The real-time audiovisual -data 
processing subsystem itiay include other image -data 
5 manipulating engines and audio-data manipulating 
engines as indicated at 149. 

In one embodiment , the memory 130-131 is formed 
as two independently addressable units. 130 and 131. 
Units 130 and 131 preferably utilize SDRAM technology 
10 (synchronous dynamic random access memory) . They may 
also utilize other high-speed random access data 
storage technologies such as video- speed static random- 
access memory subunit (VSRAM) . 

Access to the first memory unit (MEMO) 130 is 
15 managed by a corresponding first memory access control 
unit (MACO) 120. 

Access to the second memory unit (MEMl) 13 1 is 
managed by a respective and independent second memory 
access control unit (MACl) 121. 
20 The MACO unit 12 0 may exercise exclusive control 

over the address (AO) and control (CO) buses of the 
first memory unit 130. Any other device which wishes 
to gain access to the AO and CO buses then has to send 
a corresponding request to the MACO unit 12 0 over 
25 address/control bus 124. The MACO unit 120 arbitrates 
among contending requestors and grants access to the 
highest priority requestor. 

Similarly, the MACl unit 121 may exercise 
exclusive control over the address (Al) and control 
3 0 (CD buses of the second memory unit 131. Any other 
device which wishes to gain access to the Al and CI 
buses then has to send a corresponding request to the 
MACl unit 121 over address/control bus 124. The MACl 
unit 121 arbitrates among contending requestors and 
grants access to the highest priority requestor. 



35 
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The first memory unit 130 has a 32 -bit wide 
bidirectional data bus 122 which is also designated as 
DO. The second memory unit 131 has a 32-bit wide 
bidirectional data bus 123 which is also designated as 
5 Dl. Devices such as CPU 110 read and write data into 
memory units 130 and 131 by way of respective data 
buses DO and Dl . 

If desired, the illustrated, parallel memory 
architecture may be expanded to include additional 
10 memory units (MEM's) such as 130-131 and respective 
additional memory access control units (MAC'S) such as 
120-121. The advantage of this parallel memory 
architecture is, of course, that multiple requestors 
can obtain simultaneous access to different parts of a 
15 centralized memory. It is the responsibility of the 
operating system software (OS) to see to it that 
contentions for a same memory unit (e.g., 130 or 131) 
are minimized. 

The operating system (OS) software can be stored 
2 0 in a nonvolatile storage unit such as ROM (not shown) 
or CD-ROM (not shown) that is operatively coupled to, 
or forms part of, the system memory 130-131. For high 
speed nonvolatile storage such as ROM, the OS 
instructions can be executed directly from that 
25 storage. For slower- speed nonvolatile storage such as 
CD-ROM (compact disk) , the OS instiructions can be 
downloaded into system RAM 130-131 and executed from 
there . 

The illustrated embodiment of the image 
30 processing and display system 100 uses a PowerPC™ 602 
CPU 110 such as made by International Business Machines 
(IBM) of New York. Other CPU's may of course be used. 

The PowerPC™ CPU 110 has its own processor data 
bus (PD) 112 and its own address /control bus (PA/C) 
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114. The PowerPC™ data and address/control buses, 112 
and 114, couple to the memory data and memory address/ - 
control buses, 122, 123 and 124, by way of a bus 
interface unit 115. Signals from peripheral devices 
such as the CD- drives, magnetic disk drives, external 
memory and the like couple to the PowerPC™ data and 
address/control buses, 112 and 114, by way of the 
basic- I/O interface unit 105. An internal cache memory 
($) is provided within the PowerPC™ chip for enabling 
data processing by the CPU 110 at the same time that 
other devices access the system memory 130-131. Cache 
coherency is maintained through a snooping mechanism. 

Instructions and/or image data are loadable into 
the memory units 130-131 from a variety of sources (not 
15 shown) , including but not limited to magnetic or 
optical floppy or hard disk drives, a CD-ROM drive, a 
silicon ROM (read-only-memory) device, a cable headend, 
a wireless broadcast receiver, a telephone modem, etc. 



10 



20 



The downloaded instructions are not necessarily 
for execution by the CPU 110. They may instead be 
directed to the post- frame buffer, image -enhancing and 
rendering subsystem (I-EARS) 150-160-170 as will be 
seen below, or to other instruction executing 
cortponents such as, but not limited to, the audiovisual 
25 data manipulating engines 145-149. 

Buses 122, 123 and 124 depict in a general sense 
the respective data and control paths for moving 
instructions and image data into and out of memory 
units 130-131. Downloaded image data can be in 
30 compressed or decompressed format. Compressed image 
data may be temporarily stored in a compressed image 
buffer of memory 130-131 and expanded into decompressed 
format on an as needed basis. Displayable image data, 
such as that provided in a below- described frame buffer 
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[FBO 140) may be maintained as a linkable list of non- 
compressed data. 

For purposes of a below- described interpolation 
process, a first image line in a given frame buffer is 
5 referenced as an ^ upper' line and a vertically 
subsequent second image line of the frame buffer is 
referenced as a ^ lower' line. The designations of 
^ upper' and ^ lower' are made by software and are 
swappable. A same image line can be designated at 
10 different times as being ^upper' or * lower'. 

The CPU 110 sets one or more * forced-address ' 
registers (FVOA and FVIA) within the VPP 150 to point 
to respective locations in the system-memory 130-131 
that store the start of . a currently active *Video 
15 Display List' (VDL) . The VDL has a linked-list 
structure wherein the start block can point to a second 
block or back to itself, the second block can point to 
a third block or back to itself, and so forth. A video 
display list (VDL) is deemed exhausted when the video 
20 post -processor (VPP) 150 has generated a software- 
defined number of screen lines. 

After a Walid' VDL start location is written 
into one of the * forced-address' registers (FVOA and 
FVIA) , and the CPU brings the DENC 160 out of a reset 
25 state (using a DVER control register defined below) , 
the DENC begins to issue V-sync and H-sync pulses, and 
a DMA controller within the VPP 150 responsively begins 
to periodically send requests to the corresponding MAC 
(120 or 121) for successive blocks of the active Video 
30 Display List (VDL) that contain render control words 
until the VDL is exhausted. The VPP 150 stores the 
fetched control words and processes the fetched image 
data accordingly so as to render a desired image 185 on 
the video display unit (VDU) 180. 
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At the same time that the video post -processor 
(VPP) 150 is repeatedly fetching items from the active 
video display list (VDL) and rendering the 
corresponding imagery onto VDU 180, the CPU 110 and/or 
5 the other image manipulating engines 145-149 can begin 
to access binary- coded data stored within the memory 
13 0-131 and to modify the stored data within memoiry 
130-131 at a sufficiently high-rate of speed to create 
an illusion for an observer 190 that real-time 

10 animation is occurring in a high- resolution image 185 
(e.g., 640-by-480 pixels, 24 bits-per-pixel ) then being 
displayed on video display unit 180, 

In many instances, the observer 19 0 will be 
interacting with the animated image 185 by operating 

15 buttons or a joystick or other input means of the 
interactive response mechanism 195, The system user's 
real-time responses are fed back to the control port 
interface unit 104 (or directly to the CPU 110) and the 
receiving unit reacts accordingly in real-time. 

2 0 The term * real -time' as used here means 

sufficiently fast (e.g., within roughly 15 to 0.3 
milliseconds) so that a human user 190 perceives the 
corresponding changes to the audiovisual show emanating - 
from the audio and visual output units (e.g., VDU 180) 

25 to be occurring substantially instantaneously. 

The image 185 that is rendered on VDU 180 is 
defined in part by bitmap data stored in one or more 
screen-band buffers (e.g., 140 and 141) within memory 
130-131. Each screen-band buffer contains one or more 

30 scanlines of bit-mapped image data. Screen-bands can 
be woven together in threaded list style to define a 
full "screen" as will become apparent below when the 
structure of VDL's is detailed. Alternatively, a 
single screen-band (a ^simple' panel) can be defined 

35 such that the one band holds the bit-mapped image of an 



wo 96/36037 



PCTAJS96/06438 



- 20 - 

entire screen (e.g., a full set of 240 low- resolution 
lines or 480 high- resolution lines) . 

Major animation changes are preferably performed 
on a multi-buffered screen basis where the contents of 
5 a first screen buffer e.g., FBO 140, are displayed 
while one or more image modifying engines (e.g., the 
2-D image manipulating eel-engines 145 and/or the 3-D 
image manipulating triangle engine 147) operate on the 
bit -map of a hidden, second or more screen buffers 
10 e.g., FBI 141. Then the screen buffers (FBO and FBI) 
are swapped so that the previously hidden second buffer 
becomes the displayed buffer and the previously 
displayed first buffer (or yet a third buffer) becomes 
a buffer whose contents are next modified in the 
15 background by the image modifying engines . The 
swappable screen buffers (e.g., 140 and 141) can be 
respectively stored in independently accessible units 
(e.g., 130 and 131) of system memory as shown or 
jointly in a single one of the memory units. 
20 Each of the swappable screen buffers (e.g., 140 

and 141) has a respective video display list (VDL) 
associated with it. Swapping is accomplished by 
designating as * active' the VDL of the desired screen 
buffer. 

25 Each scanline in a woven- together screen-band 

buffer (e.g., FBO) may contain image data formatted in 
accordance with any one of a plurality of pre- specified 
image formats. 

In one such format (known as the 1/555 OPERA LR16 

30 format), 5 bits of each 16-bit wide, memory *halfword' 
define a red (R) color component value, 5 other bits 
define a green (G) color component value, 4 or 5 
further bits of the same half word define a blue (B) 
color component value, and the remaining one or two 

35 bits are optionally used for by- the -pixel modulation of 
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various parameters including those that control a 
downstream color look-up table (GLUT) section 230, a 
downstream interpolator 250 (Fig. 2), a downstream 
filters section 260, and a downstream dithering section 
5 270. 

Referring to Fig. 2, there is shown in block 
diagram format a portion of the system 100 that is 
referred to here as the Video display path' (VDP) 200. 

The video display path 20 0 includes a portion of 

10 system memory 130/131 that contains one or more frame 
buffers 140/141 and an associated set of video display 
control lists (VDL's) 142/143. 

The video display path 2 00 further includes the 
video post processor (VPP) 150, the digital encoder 

15 160, the DAC's 170, and the video display unit (VDU 
180, not shown in Fig. 2) . 

Control data from an 'active' control list 142/143 
is downloaded by way of data buses 122/123 into a 
control -storing portion of the VPP 150. The control- 

20 storing portion of the VPP 150 includes a set of video 
display list DMA control registers 210, a set of video 
display path control registers 240 and a so-called 
'next -GLUT' 235. 

Image data from one of the frame buffers 140/141 

25 flows downstream from the system memory 130/131 through 
a memory interface circuit (MEM I/F) 205 of the VPP and 
then through a programmably splittable FIFO 220. 
Splittable FIFO 220 can be configured to function at 
its output as a single first-in first-out buffer or it 

30 can be configured to function at its output as two 
first-in first-out buffers that are referred to as the 
lower- line FIFO 221 and the upper- line FIFO 222. The 
outputs of dual FIFO's 221, 222 may appear 
simultaneously on separate output buses of unit 220 or 
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they may be output in time multiplexed fashion over a 
shared bus. 

The outputs of FIFO 220 flow through a 
programmably selectable one or more of a plurality of 
5 color lookup tables (GLUT'S) 230. The color lookup 
tables 230 include a lower-line GLUT 231, an upper-line 
GLUT 232 and a GLUT bypass circuit 233. The GLUT 
bypass circuit 233 may be programmably substituted for 
either of the lower-line and upper-line GLUT'S 231-232 
10 on a pixel -by-pixel basis in response to each pixel's 
D-bit . 

The contents of GLUT'S 231-232 are modifiable on 
a per-scanline basis (PS) . The contents of lower-line 
GLUT 231 are always copied into upper- line GLUT 232 in 

15 each time frame corresponding to the horizontal - 
blanking period (H-BLANK) . During a PS modification, 
after the LL_GLUT contents have been copied into the 
UL_GLUT 232, the contents of the next-GLUT 235 are 
subsequently copied into the lower-line GLUT 231, still 

20 during the horizontal -blanking period (H-BLANK) . 
Update of the lower-line GLUT 231 is optional. Its 
contents could be left as is. 

The contents of the next-GLUT 235 are also 
modifiable on a per-scanline basis (PS) but such 

25 modification can be carried out even during the 
horizontal active-scan period (H-SCAN) since real-time 
video data does not have to flow through the next-GLUT 
235 . 

(In am alternate embodiment, the designations of 
30 'next', 'lower' and 'upper' GLUT can be appropriately 
swapped in round- robin fashion so as to avoid copying 
data from one to the next, but that essentially takes 
away the option of making incremental rather than 
wholesale changes to the 'next' GLUT.) 
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The output of the GLUT'S section 230 flows 
through a programmable interpolator 250. The 
interpolator 250 may be programmably enabled or 
disabled such that it provides low- resolution to high- 
5 resolution image enhancement in one, or both, or none 
of the horizontal screen direction and the vertical 
screen direction. The enable/disable of the 

interpolator's vertical and horizontal image 
enhancement functions may be controlled on a pixel -by- 

10 pixel (PP) basis in response to each pixel's D-bit as 
will be explained below. 

The output of interpolator 250 flows through a 
set of programmably selectable or bypassable filters 
260 . In one mode, the filters 260 provide 1-14-1 

15 horizontal tap filtration. In another selectable mode, 
the filters provide 1-6-1 horizontal tap filtration. 
In a third programmably selectable mode, the horizontal 
filtering function of section 260 is bypassed. A pre- 
selected one of filters 260 may be enabled or bypassed 

20 on a pixel -by -pixel (PP) basis in response to each 
pixel's D-bit. Pre- selection of one of filters 260 may 
be carried out on a per-scanline (PS) basis. 

The output of filters section 260 next flows 
through a dithering section 270. Dithering is 

25 programmably ordered according to the X and Y 
coordinates of the corresponding screen pixel or it is 
random. Dithering may be turned on or off on a pixel - 
by-pixel (PP) basis in response to each pixel's D-bit. 

The output of the dithering section 270 flows 

3 0 through a programmably bypassable conversion matrix 
162. Conversion matrix 162 may be used for converting 
RGB- formatted image data into YUV- formatted image data. 
(Other conversion functions for bypassable conversion 
matrix 162 are also contemplated, such as YUV-to-RGB 

35 conversion.) 
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The digital encoder 160 adds further signals such 
NTSC or PAL burst information to the digital image 
information and provides appropriate cross -modulation 
or mincing as needed for the corresponding output. The 
5 conversion matrix 162 may be enabled or bypassed on a 
pixel -by -pixel (PP) basis in response to each pixel's 
D-bit - 

The corresponding analog output from the digital- 
to-analog converter (DAC's) section 170 may be in the 
10 form of a one-wire composite signal (Comp) , or a two- 
wire luminance /chromiance pair (Lum/Chrom) or a three - 
wire RGB triad. These signals are output to the 
corresponding monitor 180 for display. The output 
signals 276 of dithering section 270 and next -described 
15 control signals 246 are provided to the exterior of the 
I -EARS chip for use by an external digital encoder 
where desired. 

A variety of timing and control signals 246 pass 
between the digital encoder 160 and the VPP 150. 
20 included in the signals 246 are Hsync pulses and Vsync 
pulses, both generated by the digital encoder 160 in 
synchronism witb th.e vidCLK. 

As earlier mentioned, an upstream portion 205 of 
the VPP 150 operates in synchronism with the sysCLK 
25 while the digital encoder 160 and a downstream portion 
of the VPP 150 (from the output of splittable FIFO 22 0 
and down) operate in synchronism with the vidCLK. For 
odd field numbers, the corresponding Vsync pulse is 
generated by the DENC 160 so as to coincide in time 
3 0 with the corresponding Hsync pulse of the first raster 
line. For even numbered fields, the Vsync pulse is 
generated to occur approximately in the middle of the 
first raster line. The VPP 150 determines whether the 
current field is odd or even by testing for coincidence 
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between the Hsync and Vsync pulses and acts accordingly. 
Figs. 3A and 3B combine respectively one above 
the next to show how differently- formatted image data 
may be stored in system memory and thereafter 
5 downloaded into, and re-organized within the FIFO 220. 

Coliomn 340 of Fig. 3A lists three different image 
formats which may be selected on a line-by-line basis 
for processing by VPP 150. They are: (a) Opera_LR16 
format; (b) M2_16-bit format; and (c) M2_32-bit format. 
10 Although these three specific formats are shown, it is 
within the scope of the invention to accommodate other 
image -defining formats. 

The memory interface circuit 205 of Fig. 3B 
responds to a format code stored in an FB_FORMAT 
15 register 214 (Fig. 3B) and accordingly fetches the 
image -defining data from system memory 130-131, re- 
organizes it and stores the re -organized data into 
appropriate positions within the splittable FIFO 220. 

The splittable FIFO 220, in one embodiment, is 
2 0 implemented as a combination of a static random access 
memory (SRAM) and an access- controlling state machine. 
The output of this combination behaves as a single or 
dual set of first- in/first-out buffers (FIFO's) 
depending on whether the current FIFO mode is single 

2 5 mode or split mode. The input to this SRAM/state - 

machine combination functions more like a random access 
memory with the point or points of next -input write 
being controlled by the state machine and the FB_FORMAT 
register 214 and other control fields (LV and UV) . 

3 0 FB_FORiyiAT register 214 may be programmed to store 

any one of the following format- specif ying codes: 
Opera_LR16 format, M2_16-bit format, and M2_32-bit 
format. The system may be expanded to handle other 
formats as well. The format -specifying code within the 
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FB_FORMAT register 214 may be modified on a per- 
scanline (PS) basis in synchronism with the Hsync 
pulse . 

If a corresponding load- shadow signal 
5 (FB_FORMAT_L) is set true (to logic "1") then a 
corresponding, next-to-be used format -specifying code 
is conditionally loaded into an FB_FORMAT shadow 
register 212 in synchronism with the sysCLK 117. This 
next- to-be used code is downloaded from system memory 
10 130-131 into the FB_FORMAT shadow register 212 by way 
of path 211 from the memory interface circuit during a 
shadow -download time period. The shadow- download 
period may occur any time prior to a periodically 
repeated transfer (213) of the shadow control data 
15 (212) into the current control register (214). The 
shadow-download period may occur during the horizontal 
active- scan period (H-SCAN) . During each horizontal - 
blanking period (H-BLANK) , the contents of the 
FB_FORMAT shadow register 212 are moved by way of path 
2 0 213 into the FB_FORMAT register 214. 

The format -specifying code for each frame buffer 
line is defined by a control word (VDLCW, described 
below) which is first stored in one of the control 
lists (VDL's) 142/143 of the system memory (Fig. 2) and 
25 then downloads by way of memory interface circuit 205 
into the FB_FORMAT shadow register 212. The FB_FORMAT 
shadow register 212 is one of plural shadow- control 
registers that may be downloaded with shadow control 
data prior to transferring such shadow control data to 
30 a corresponding current -control register. Shadow- 
download occurs in synchronism with the sysCLK 117. 
Shadow- to- current copy occurs in synchronism with the 
vidCLK 167. 

Registers 212 and 214 are just one example of a 
35 'shadow- current' control register pair. As explained. 
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when a corresponding shadow-copy enabling bit (e.g., 
FB_FORMAT_L) or an enabling bit- string is appropriately 
set, the contents of the shadow register (212) are 
changed and thereafter copied into the current control 
5 register (214) at the appropriate time (e.g. when a new 
VDL takes effect in approximate coincidence with or 
just before the Hsync pulse) . 

Another example of a * shadow- current ' control 
register pair is shown schematically at the bottom of 

10 Fig. 3B at 241 as a compounded set of boxes. Yet 
another example of a " shadow- current ' control register 
pair is shown at 242. Each of the respective current 
control registers in the HPD and VPD ^ shadow- current ' 
control register pairs, 241 and 242, is independently 

15 modifiable on a per- scanline basis (PS basis) as is the 
FB_FORMAT register 214. 

Referring to Fig. 3A, image data is periodically 
fetched by the memory interface circuit 2 05 from the 
system memory 130/131 in the form of 32 -bit wide memory 

20 words. In the so-called Opera_LRl6 format, each 32 -bit 
memory word contains 16 bits defining a first pixel of 
a first frame buffer line and 16 further bits defining 
a vertically adjacent pixel of a second frame buffer 
line. 

25 As earlier explained, 15 of the bits in each 

memory half word may be used for defining respective 5- 
bit wide color components such as R-G-B or Y-U-V. (If 
the system memory data represents RGB color components 
and the DENG 160 expects YUV, then it is generally 

30 desirable to enable the downstream RGB -to- YUV 
conversion matrix 162. If the system memory data 
already represents YUV color components as expected by 
the downstream DENG 160, then it is generally desirable 
to bypass the downstream conversion matrix 162,) 
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The 16 th bit of each half word is a so-called 
'D-bit' which may be used for modulating various 
parameters of the I-EARS 150-160-170 on a pixel-by- 
pixel basis, including enablement or bypass of the 
5 downstream conversion matrix 162. 

In the Opera_LR16 format, a first half word of 
each fetched 32 -bit wide memory word represents the 
D-RGB information (or alternatively, the D-YUV 
information; or further alternatively, the D-ABC 
10 information, where A,B,C are coordinates in another 
3 -dimensional color space) for a first frame buffer 
pixel on a first frame buffer line. A second half word 
in the same 32 -bit memory word represents the D-RGB 
information (or D-YUV or D-ABC information) for a 
15 second pixel of the frame buffer that is vertically 
adjacent within the frame buffer to the first pixel- 
(A "frame-buffer line' is not necessarily the same as 
a display line on the screen of the VDU 180. If 
vertical pixel -doubling (VPD) is active, two screen 
2 0 display lines are generated for each corresponding 
frame-buffer line. If horizontal pixel -doubling (HPD) 
is active, two horizontally- adjacent screen display 
pixels are generated for each corresponding frame - 
buffer pixel. This will be detailed below.) 
25 Reference numeral 301 of Fig. 3A points to a 

first 32 -bit memory word that is formatted in 
accordance with Opera_ItRl6 format. Reference numeral 
302 points to a second 32 -bit memory word of the same 
frame -buffer band. The second memory word 302 contains 
30 the D-RGB information (or D-YUV or D-ABC information) 
for, by way of example, pixel number N of frame buffer 
line-0 and also for pixel number N of frame buffer 
line-1 while the first memory word 301 contains the 
corresponding information for preceding pixels of the 
35 respective frame buffer lines, 0 and 1. The same 
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organization repeats for frame-buffer lines 2 and 3 if 
any, 4 and 5, and so forth. 

The 32 -bit wide, Opera_LR16 formatted pixel words 
are arranged sequentially in the memory space of system 
5 memory 130-131 for each successive, vertically- adjacent 
pair of pixels of frame buffer lines 0 and 1, then for 
each successive pixel pairs of frame buffer lines 2 and 
3 if any, and so forth. 

The system software defines which of the two 
10 half words in an Opera LR16 memory word 3 01 belongs to 
a frame buffer 'upper- line' (UL) and which . belongs to a 
frame buffer 'lower- line' (LL) . Software definition of 
UIj and LL occurs as follows: The system CPU 110 writes 
a "forced video address' into a DMA control register 
15 (210) within the VPP 150, The forced video address 
(FVOA for even fields, FVIA for odd fields as will be 
detailed below) points back into system memory into a 
video display control list (VDL) . There are two 
* mandatory' entries in each VDL which are referred to 
respectively as the first lower-line in-current frame- 
buffer address (LL_FB address) and the first upper- line 
in- current frame -buffer address (UL_FB address) . 

The LL_FB and UL_FB address words are each at 
least 32 -bits wide and each can point to any group of 
25 bits within the system memory 130-131 beginning at a 
byte boundary. (A byte contains 8 sequential bits of 
data and may also contain additional error- 
detect /correct bits such as a parity bit) . The VPP 150 
fetches the pointed- to LL_FB and UL_FB address words, 
when such a fetch is called for, but ignores the least 
significant bit of each of the LL_FB and UL_FB address 
words. Thus the VPP 150 has an access resolution into 
system memory down to the half word level. The LL_FB 
address word points, as shown in Fig". 3A near 301, to 
35 the memory halfword that is to be directed to a lower- 
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line (LL) section 221 of the splittable FIFO 220. The 
UL_FB address word similarly points to the halfword in 
memory that is to be directed to the upper- line (UL) 
portion 222 of the splittable FIFO 220. 
5 Referring to Fig. 3B, it is seen that the D-RGB 

information (or D-YUV or D-ABC information) of the 
line-1 half words are directed by the memory interface 
circuit 205 into the lower- line FIFO section 221. The 
D-RGB information {or D-YUV or D-ABC information) of 
10 the line-0 halfwords are similarly routed by memory 
interface circuit 205 into the upper- line FIFO section 
222 . 

Unlike the 32 -bit per- word format of the system 
memory 130-131, the entries of FIFO 220 have a 25-bit 
15 format. For the split mode, each side 221 and 222 of 
splittable FIFO 220 is preferably at least 64 entries 
deep. In the unsplit mode, splittable FIFO 22 0 can 
operate as a single FIFO having a depth of at least 128 
entries, each entry being 25 -bits wide. The depth of 
2 0 the splittable FIFO 22 0 can of course, be changed as 
appropriate to account for memory access latency within 
the system 100 . 

One bit of each FIFO entry stores the D-bit of 
the corresponding memory halfword and the remaining 24 
25 bits are subdivided into three sections (e.g., each 8- 
bits wide) for storing the respective color space 
coordinate information (RGB or YUV or the generic, ABC) 
of the corresponding frame buffer pixel. 

In the case of Opera LR16 format, where there are 
3 0 only 5 bits in system memory for each color space 
coordinate, the least significant three bits of each 8- 
bit wide one of the R, G, and B fields (or A,B,C 
fields) within the FIFO 220 are filled with zeroes. 
The more significant five bics are filled with the 
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corresponding five bits from the respective color space 
coordinate fields of the corresponding memory half word. 

Referring to memory words 316 and 317 of Fig. 3A, 
these show how image data may be formatted according to 
5 the so-called *M2__16-bit' format. Each 32 -bit wide 
memory word stores the D-RGB (or D-ABC) information of 
two pixels that are horizontally adjacent within the 
system-memory frame-buffer. When the FIFO 220 is in 
split mode, the UL_FB address word points to the memory 

10 start location of 'upper- line' pixels and the LL_FB 
address word points to the start of 'lower- line' pixel 
data. FIFO 220 is filled by alternately fetching 
blocks of memory words corresponding to upper and lower 
frame buffer lines. When the FIFO 220 is in the 

15 unsplit mode, only the LL_FB address word is used for 
data fetch. 

When a software -defined number of frame-buffer 
pixels per frame-buffer line is exhausted, the UL_FB 
and/or LL_FB address words are appropriately 
20 incremented to point to the respective next locations 
in system memory that contain the logically- next set of 
upper and lower frame -buffer lines. (See below 
explanation of the MOD field in the Frame-buffer DMA 
Control Word.) 

25 Fetches of data from system memory are made in 

quantums of or guadbytes (32 bytes each) . The memory 
interface circuit 205 tries to minimize data bus 
utilization time (on DO or Dl) by fetching as many 
quantum fetches as possible per FIFO fill. 

3 0 FIFO 220 has two levels associated therewith for 

preventing overfill and underfill. Level 314 (Fig. 3B) 
is the near- empty level and is programmably- adjustable 
(in one embodiment to FIFO filled/ full ratios of 
32/128, 64/128 and 96/128). The upper level 312 is the 

35 ready- for- next -fetch level, also referred to as the 
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overfill -protect level 312. Level 312 is preferably 
set so that one or more memory quadbyte fetches may be 
made without overfilling the FIFO. In one embodiment, 
the FIFO filled/full ratio for the overfill -protect 
5 level 312 is 96/128. 

If the filled level of the FIFO 220 is or drops 
into the range between levels 312 and 314, then fetch 
requests for filling the FIFO are made at normal 
priority. The requested fetch size is equal to the 
10 difference between the full level and the overfill - 
protect level 312- (In one embodiment, the requested 
fetch size is equal to 32/l28ths of the FIFO full 
depth . ) 

When the amount of stored data within the FIFO 
15 220 is or falls below the programmably- definable near- 
empty level 314, fetch requests are automatically 
generated at high priority. The requested fetch size 
is still equal to the difference between the full level 
and the overfill -protect level 312 but of course 
20 repeats at high priority until the FIFO filled level 
rises above the near-empty level 314, The FIFO 220 
accordingly requests memory access at normal and high 
priority in a manner which automatically prevents 
overfill and automatically minimizes the likelihood of 

25 underfill. 

Referring to the memory words labeled as 332 and 
333 in Fig. 3A, these are formatted according to a so- 
called M2_32-bit format. Each of memory words 332 and 
333 stores the D-RGB (or D-ABC) information of a single 

30 high resolution pixel. Each of the R,G,B fields (or 
A, B,C fields) of each M2_32-bit formatted memory word 
are respectively 8-bits wide. The D-bit field is one 
bit wide. A 7-bit wide reserve field (X) is further 
included in each of memory words 332 and 333. The 

35 D-RGB (or D-ABC) information of each of memory words 
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332 and 333 is routed by the memory interface circuit 
205 into a respective 25-bit wide FIFO entry location. 

Referring to Fig. 3B, the split table FIFO 220 has 
a FIFO output circuit 32 7 that is clocked differently 
5 depending on the * current' states of two pixel -rate 
control register sets, the horizontal pixel -doubling 
(HPD) register set 241 and the vertical pixel -doubling 
(VPD) register set 242. Each of register sets 241 and 
242 is shadowed and update-able on a per- scan- line (PS) 
10 basis. 

Each of the horizontal pixel -doubling (HPD) and 
vertical pixel -doubling (VPD) functions may be 
independently turned on or off. When pixel -doubling is 
enabled in a given direction (vertical or horizontal) , 

15 interpolation may be turned on or off in that given 
direction on a pixel -by-pixel basis. If HPD is turned 
on (active) , then two screen pixels are generated in 
the horizontal direction for each frame-buffer pixel . 
If horizontal interpolation is turned off at the same 

20 time, the two horizontally-adjacent screen pixels will 
have the same color values. If horizontal 

interpolation is instead turned on at the same time, 
the color components of each of the two screen pixels 
will be set according to sub-position weighted 

25 interpolation with neighboring frame buffer pixels. 

Similarly, when VPD is turned on (active), two 
screen pixels will be generated in the vertical 
direction for every frame buffer pixel. If vertical 
interpolation is turned off, the two vertically- 

3 0 adjacent screen pixels will have identical color 
values. If vertical interpolation is turned on, the 
color value of each of the two vertically- adjacent 
screen pixels will be defined according to weighted 
interpolation of the current frame-buffer pixel with 

3 5 neighboring frame -buffer pixels. 
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If pixel -doubling is turned off in a given 
direction (horizontal or vertical) , then it is not 
advisable to turn on interpolation in that same 
direction. The allowed combinations are shown in the 
5 below TABLE- 1. 

TABLE- 1 



Pixel Doubling is active in 
the indicated direction? 


Interpolate in the 
indicated direction? 


Yes 


No 


Yes 


Yes 


No 


No 


No- (This is a disallowed 
mode) 


Yes- (This is a 
disallowed mode) 



The bottom of Fig. 3B indicates the rates at 

15 which the FIFO output circuit 327 is clocked for 
different settings of HPD and VPD. If HPD is on and 
VPD is off (HV=0,1), then the FIFO output circuit 327 
is clocked at twice the video pixel rate (vidPRx2) . 
For the pixel -doubling combinations of HV=0,0 and 

2 0 HV=1,1, the FIFO output circuit 327 is clocked at a 
frequency equal to the video pixel rate (vidPRxl) . For 
the pixel -doxibling combination of HV=1,0, the FIFO 
output circuit 327 is clocked at half the pixel 
frequency of the video monitor (vidPRxl/2) . 

25 Multiplexer 328 receives the respective clock signals, 
vidPRx2, vidPRxl, and vidPRxl/2 and supplies the 
appropriate clock signal no the FIFO output circuit 327 
in accordance with the current settings of HPD register 
sen 241 and VPD register set 242. The 25 -bit-wide 

30 outputs of upper line FIFO 222 and lower line FIFO 221 
next flow to the GLUT section 23 0 at the rate selected 
by multiplexer 328. 
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Referring to Fig. 4A, the five more significant 
bits of each (5 + 3) -bits wide, R or G or B color 
component field output by splittable FIFO 220 is routed 
to a respective 5 -bit- wide address input of a 
5 corresponding R or G or B subCLUT. Each (5+3) -bits 
wide, color component field output by the splittable 
FIFO 220 is referred to as a ^PEN' signal. The 
designations of R or G or B for each PEN signal may be 
substituted by a respective Y or U or V; or more 

10 generically by a respective A or B or C. 

Fig. 4A shows how the lower line CLUT 231 is 
subdivided into its respective R, G and B subCLUT's 
431, 432 and 433. Each of subCLUT's 431-433 stores 
thirty-two 8-bit wide entries. Each of subCLUT's 431- 

15 43 3 is independently addressable for purposes of 
reading from or writing to its respective thirty- two 
entries. Additionally, there is a 24 -bit wide 33rd 
storage entry which is alternatively selected as the 
output of the lower-line GLUT 231 when a zero-detector 

2 0 circuit 43 0 detects the condition where the five more 
significant bits of each of the RGB PEN output fields 
from the LL-FIFO 221 are simultaneously equal to zero. 
Zero detector 43 0 may be implemented as a 15 -input NOR 
gate . 

25 The least significant of the 5 address input bits 

to the B subCLUT 433 may be selected from four sources 
on a pixel -by -pixel basis. It can either be the fifth 
most significant bit (5th msb) of the corresponding 8-, 
bit wide LL-FIFO output for the B/V PEN field or the 

30 5th msb of the 8-bit wide G/U PEN field of LL-FIFO 221, 
or a zero ("0") or a one ("1"). The selection is made 
by multiplexer 434. Degradation of color-palette 
resolution along the blue axis of the RGB color space 
is believed to be less noticeable to the human eye than 

35 similar loss along the red and green axes. 
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The selection control input of multiplexer 434 is 
defined by the output of multiplexer 435. Multiplexer 
435 has as its inputs a first 2 -bit wide blue-select 
register, BSq and a second 2 -bit wide blue -select 
5 register, BSi. Register BSq forms part of a below- 
described VDCO register. Register BSi forms a part of 
a below-described VDCi register. Each of the VDCO and 
VDCl registers is modifiable on a per-scanline (PS) 
basis from a VDCO/1 shadow register. 
10 The D-bit output from LL-FIFO 221 can change on 

a per-pixel basis (PP) given that the D-bit value for 
each frame-buffer pixel is established in the system 

memory 130-131. 

If the contents of the BSq and BSi registers are 
15 different, then the LL-FIFO output D-bit will modulate 
the output of multiplexer 435 accordingly. If the 
contents of current control registers BSq and BSi are 
the same, then the setting of the D-bit will have no 
effect on the output of multiplexer 435. It will be 
20 fixed to the common control code stored in BSq and BSi- 
Multiplexer 434 is included in the VPP so that 
the 5th msb of the B/V PEN signal can be optionally 
used for independent pixel -by-pixel control of one or 
both of so-called H and V sxibposition bits used by the 
25 downstream interpolator 250. If the 5th msb of the B/V 
PEN signal is used for modulating the H and V 
subposition bits on a pixel -by-pixel basis for 
interpolation purposes, such modulation of this bit may 
cause undesired artifacts in the rendered image if the 
3 0 same bit is also used for defining the least 
significant address bit entering the B subCLUT 433. It 
may be desirable to instead fix the least significant 
address input bit of the B subCLUT 433 to a zero ("0") 
or to a one ("1") or to make it a copy of the least 
35 significant address bit going into the G subCLUT 432. 
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Multiplexer 434 provides these options in response to 
the output of the B- select control multiplexer 435 as 
indicated in Fig. 4A. 

Lower- line CLUT 231 provides a software -defined 
5 mapping of each more significant 5 -bits of the LL-FIFO 
PEN signals into a corresponding 8 -bit wide signal. 
The 8 -bit wide output of the R subCLUT 431 next flows 
to a bypass multiplexer 441. In a first state, the 
bypass multiplexer 441 outputs the same 8 -bit wide 
10 color coitponent signal received from the R subCLUT 431. 
In a second mode, the bypass register 441 outputs a 
combined 8 bits (8=5+3) received from the respective 5 
and 3 -bit wide outputs of delay units 437 and 438. The 
output of delay unit 437 is simply the most significant 
15 5 bits of the R/Y PEN signal output from the LL-FIFO 
221, but delayed in time by an amount corresponding to 
the read-mode propagation delay of the R subCLUT 431. 
The 3 -bit wide output of delay unit 438 is similarly 
delayed so as to coincide in time with the output of 
20 delay unit 437. Delay unit .438 receives a selected one 
of four 3 -bit wide signals from a CLUT-bypass drive 
multiplexer 436. 

The selection control input of the CLUT-bypass 
drive multiplexer 43 6 is controlled by. a 2 -bit wide 
25 CBPSEL register 443 (CLUT-bypass select register 443) . 
One of the four inputs to the CLUT-bypass drive 
multiplexer 436 is derived from the corresponding three 
least significant bits (Isb's) of the 8-bit wide R/Y 
PEN signal output from FIFO 220. A second of the 
30 inputs to multiplexer 436 is derived from the 
corresponding three most significant bits (msb's) of 
the R/Y PEN signal output from FIFO 220. A third of 
the inputs of multiplexer 43 6 is a predefined constant 
3-bit field such as 000. The fourth input _ to 
35 multiplexer 436 can be any other 3 -bit wide field 
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including a pseudo randomly generated field. In the 
embodiment further described below, the fourth input is 
a repeat of the constant 000 field. 

The CBPSEL register 443 forms a part of a VDLI 
5 register described below. The VDLI register is 
modifiable on a per-scanline (PS) basis. 

Another register within the VDLI register is the 
illustrated CLUT-bypass enable register (CLUTBP) 445. 
The CLUTBP register 445 drives one input of AND gate 
10 442. A second input of AND gate 442 is driven by the 
corresponding D-bit output from FIFO 220. When the 
CLUTBP register 445 outputs a logic "0", the GLUT 
bypass function is disabled and multiplexer 441 simply 
passes through the 8 bits from the R subCLUT 431. When 
15 the output of CLUTBP register 445 is logic "1", GLUT 
bypass is enabled and the D-bit passes through AND gate 
442 to control the selection terminal of bypass 
multiplexer 441. 

When CLUTBP=1, the D-bit can be used to increase 
20 the color palette space available to programmers by as 
much as a factor of two. One half of the doubled 
palette space may be defined by the configuration of 
the CLUT bypass circuitry formed by elements 436-437- 
438 and 443. The other half of the doubled palette 
25 space may be defined by the color-mapping entries 
downloaded into the programmable LL-CLUT 231. Of 
course, if some or all of the downloaded color-mapping 
entries are redundant with the output of the CLUT 
bypass circuitry formed by elements 436, 437, 438, 443; 
30 then the color paletce space available to programmers 
will be accordingly reduced. 

Although Fig. 4A shows the CLUT bypass circuitry 
only for the R subCLUT 431, it should be understood 
that similar circuitry is provided for bypassing the G 
35 subCLUT 432 and further similar circuitry is provided 
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included in that embodiment of the VPP 150. 

Each listed register is 32 -bits wide. Each 
register is listed according to its full name and also 
according to an identifying acronym. TABLE- 2 also 
5 indicates which registers that are readable by the CPU 
and/or writable into by the CPU and/or clearable by the 
CPU. If the entry is "R" only, that means that the 
register is only readable by the CPU but cannot be 
written to by the CPU. TABLE-2 also indicates which 

10 registers may be written to during a DMA fetch of video 
display list control words and which registers are read 
by the DMA mechanism. TABLE-2 also indicates the 
coupling between the digital encoder and the VPP 
control registers. The indicator " (W) " means that the 

15 digital encoder indirectly defines the contents of this 
register by means of the horizontal and vertical video 
sync pulses (Hsync and Vsync) . 
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TABLE- 2 



Register N»me 


Acronym 


Read/Write/Clear 
by CPU 


Read/Write 
by DMA 


Read/Write 
by DENC 


Forced VDL 0 Addrett 


FVOA 


RW 


R 




Forced VDL 1 Address 


FVIA 


RW 


R 




Active Video Display Info 


AVDI 


R 


W 





Video Display List Info 


VDLl 


R 


W 




Video Display Control 0 


VDCO 


R 


w 




Video Display Control 1 


VDCl 


R 


w 




Video Display Screen Info 


VDSI 


R/W 








VLOC 


R 


R 


(W) 


Vertical Line Interrupt 


VINT 


RW 




(W) 


Vert. Line Inierrupi Clear 


VINT 


C 






Dither Matrix 0 


DMTO 


RW 






Dither Matrix 1 


DMT I 


R/W 






LFSR Seed 


LFSR 


RW 








DVER 


R/W 




R 


DMA Snoop Control 


DSNP 


R/W 


R 





The fields in the specific registers of TABLE -2 
are now detailed as follows. 

20 Forced Video Display List 0 Address Register (FVOA) 

32 bits > 



VDL ADDR 0 



VDL__ADDR_0 is the forced start address for the 
active video display list (VDL) when the current screen 
25 is an even field. 



Forced Video Display List 1 Address Register (FVIA) 
^ 32 bits 



VDL ADDR 1 
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VDL_ADDR_l is the forced start address for the 
active video display list (VDL) when the current screen 
is an odd field. 

Active Video Display Info Register - (AVDI) 



5 



11 bits 


11 bits 


1 bit 


1 bit 


8 bits 


HSTART 


HEND 


HPD 


VPD 












(reserved) 



The contents of the Active Video Display Info 
Register (AVDI) may be defined by an Active Video 
Display Control Word (AVDCW) that is optionally 
10 included in the video display list (VDL) . The CPU 110 
can only read these fields: 
HSTART (11 bits) : 

The digital encoder (160) can be instructed to 
keep horizontal blanking on beyond the end of the 
front porch in the output NTSC or PAL video 
signal. HSTART defines for the digital encoder 
the number of screen pixels after the front porch 
for which horizontal blanking is to be kept 
active . 
2 0 HEND (11 bits) : 

This horizontal -end count defines the number of 
vidCLK pulses or the nxomber of screen pixels for 
which horizontal blanking is not active. In 
other words, this defines the effective 

25 horizontal screen width for a corresponding line 

in the f rame-buf f er . At the end of the HEND 
count, horizontal blanking is turned back on 
again irrespective of whether the ending pixels 
of the corresponding f rame-buf fer line have not 

30 yet been exhausted. 

HPD (1 bif,) ; 
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Horizontal pixel doubling active. A logic "1" in 
this bit position means that horizontal pixel 
doubling is turned on so as to produce two active 
horizontal video pixels for every frame buffer 
5 pixel . 

VPD (1 bit) : 

Vertical pixel doubling is active. A logic "1" 
here indicates that vertical pixel doubling is 
turned on such that two active vertical video 
10 pixels are produced for every frame buffer pixel. 



Video Display List Info Register - VDLI 



II 


1 


2 


2 


1 


1 


1 


1 


1 




II CLUT_BP 


RGB 


CBP_SEL 


FB_FORMAT 


FIIiT_TYPE 


FTRAN 


BKG_TRAN 


VIL 


RDM 





The contents of the Video Display List Info 
15 Register (VDLI) may be defined by a Video Display List 
Control Word (VDLCW) found within the VDL. The VDLI 
fields are as follows: 
CLUTBP (1 bit) : 

A logic "1" here indicates that GLUT bypass is 

2 0 enabled. 

RGB (1 bit) : 

A logic "1" here indicates that the original 
image is in RGB format and the RGB-to-YUV 
conversion matrix 162 in the digital encoder 
25 should be turned on. A logic "0" at this bit 

position indicates that the original image is 
already in YUV format and the matrix converter 
162 is to be bypassed. 
CRP.qEL (2 bits) : 

3 0 GLUT bypass select. When either of the soft 

GLUT'S 231-232 is bypassed, the three least 
significant of the 8 bits output by multiplexer 
441 (Fig. 4A) are supplied from a selected on of 
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four sources. The below TABLE- 3 shows one 
possible coding for the four sources. 



TABLE -3 



CBPSEL 
(2 bits) 


Meaning 


0 


Fill with O's 


1 


Fill with 3 msb's from FIFO 


2 


Fill with O's 


3 


Fill with 3 Isb's from FIFO 



10 FBFORMAT (2 bits) : 

Frame buffer format. As explained above, there 
are three image encoding formats for the frame 
buffer within the system memory. The below 
TABLE- 4 shows the respective formats. A fourth 

15 format may be added if desired. 



TABLE -4 



FBFORMAT (2 bits) 


Meaning 


0 


16 -bit Opera LR format 


1 


M2 16-bit format 


2 


M2 32-bit format 


3 


reseirved 



FILT_TYPE (1 bit) : 

Filter type. If post- interpolation filtering is 
enabled, this field selects one of two filter 
25 types: full resolution ( = 1) or' quarter 

resolution (=0) . 
FTRAN (1 bit) : 

Force transparency. If this bit is set, a 
transparency signal is sent to the digital 
30 encoder and is forced to be on for the entire 
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line. 
BKCTRAN (1 bit) : 

Background transparency. If this bit is set, the 
transparency signal sent to the digital encoder 
5 will be set whenever a background pixel is 

detected. The zero-detector 430 of Fig. 4A 
detects the so-called background pixel condition - 
VTL (1 bit) : 

Vertical interpolation line. If this bit is set, 
10 vertical interpolation for the first scan line 

associated with this VDL will be turned off. The 
remaining lines associated with this VDL will 
have vertical interpolation enabled or not 
depending on the D-bit and the VIE_0/1 set in 
15 registers VDCO and VDCl . 

RDM (1 bit) : 

Random dither matrix index. If this bit is set, 
an LFSR seed will be used to randomly select 
dither matrix entries for use with each pixel. 
20 If this bit is clear, the row and column position 

values of the pixel within the active display 
area will be used to index into the matrix and 
use the corresponding entry for that pixel . 



video Display Control 0 Register - VDCO 



2 


2 


2 


1 


1 


1 


1 


1 


11 


HS 


vs 


BS 


HIE 


VIE 


FE 


DE 


MBE 





There are two video display control registers, 
VDCO and VDCl. The contents of the VDCO and VDCl 
registers are updatable on a per-scanline basis (PS 
30 basis) by means of a below-described video display 
control word. The D-bit selects all the bits of one of 
registers VDCO and VDCl on a per pixel basis as the 
active set. A portion of this multiplexing scheme is 
shown in Fig. 4A by element 435 and the BSq and BS^ 
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registers. If a control parameter is to remain 
unaffected by the D-bit, then the corresponding fields 
in the VDCO and VDCl registers should be set to the 
same value. If they are different, the D-bit will 
5 select one of the different values as the active value 
for each corresponding pixel . 

HS 12 bits) : 

Horizontal subposition bit select. This is used 
in Opera -style interpolation. The below TABLE -5 
10 shows the encoding for four possible sources. 



TABLE -5 



HS 


Meaning 


0 


Use D-bit 


1 


Use Blue Pen 5th msb 


2 


Set to 0 


3 


Set to 1 



VS (2 bits) : 

Vertical subposition bit select. The vertical 
subposition bit is similarly selectable from four 
20 sources as shown by the below TABLE- 6. 



TABLE -6 



VS 


Meaning 


0 


Use D-bit 


1 


Use Blue Pen 5th msb 


2 


Set to 0 


3 


Set to 1 



BS (2 bits) : 

Blue PEN 5th msb select. As seen in Fig. 4A, the 
fifth most significant bit of the 8 -bit wide blue 
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PEN signal can be redefined on a per pixel basis. 
The following TABLE- 7 shows the options. 



TABLE -7 



BS 


Meaning 


0 


Use 5th msb of B/V PEN signal 


1 


Use Green PEN Sth msb 


2 


Set to 0 


3 


Set to 1 



HIE (1 bit) : 

10 Horizontal interpolation enable. As explained 

above, when horizontal interpolation is active, 
the interpolator 250 outputs two horizontal 
pixels for each frame buffer pixel where the 
values of the two horizontal pixels are defined 

15 separately by an interpolation function. When 

HIE is turned off, the two horizontal pixel 
values that are output are the same and are equal 
to that of the corresponding low- resolution input 
pixel then being processed by the interpolator 

20 250. 
FE (1 bit) : 

Filter enable. When reset to logic "0", the 
post- interpolation filtration 260 will be 
bypassed. When set to logic "1", the filter 
25 function defined by FILT_TYPE in the VDLI 

register is enabled. 
DE (1 bit) : 

Dither enable. When this bit is set, the dither 
function 270 is enabled. When this bit is 0, the 
30 dither function is bypassed. 
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MBE (1 bit) : 

Matrix bypass for digital encoder. When set to 0, 
disables the RGB-to-YUV conversion matrix 162 
within the digital encoder 160. 

5 Video Display Control 1 Register - VDCl 



2 


2 


2 


1 


1 


1 


1 


1 


11 


HS 


VS 


BS 


HIE 


VIE 


' FE 


DE 


MBE 





See field definitions for VDCO . 

Programmers may use the per -pixel modulation 

10 capabilities of the D-bit in combination with the 
settings of the fields in video display control 
registers VDCO and VDCl to create a number of 
interesting screen effects. 

For example, if horizontal and/or vertical 

15 interpolation (HIE and VIE) is turned off in a screen 
region defining an object border such as the border of 
a score box, then the same color value will be 
replicated in pairs of adjacent pixels. This can be 
used to create a visual effect of strong continuity 

2 0 from one pixel to the next. Such strong continuity may 
be desired for drawing a sharp outline around a visual 
object such as a score -keeping box in a video game. 
When horizontal and/or vertical interpolation are 
turned on, the difference between adjacent pixels tends 

25 to be more smooth rather than sharp. This smoothing 
effect may be turned on and off as desired to create 
visual effects such as that of a rounded or foggy- 
object edge. 

Additional control over the smoothness or 
30 sharpness of horizontally adjacent pixels may be 
obtained by modulating the FE (filter enable) bit. 

In some regions of a displayed object it may be 
desirable to turn on the dithering function 270, so as 
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to, for example, stitch together the seams of frame 
buffer objects that were obtained from different 
sources. In other areas of the same displayed image, it 
may be disadvantageous to have dithering turned on. 
5 For example, if a certain region is to have a solid 
same color throughout, dithering would undesirably add 
visual noise to this certain region. In this 

situation, it is beneficial to turn the dithering 
function off. The pixel -by -pixel control over the 
10 D-bit lets programmers turn dithering on and off as 
desired. 

The matrix- enable/bypass control bit (MBE) may be 
similarly used to define window regions within the 
screen display for which RGB-to-YUV conversion is or is 

15 not desired. For example, if a given region in the 
system-memory frame-buffer is already encoded as YUV 
(because, for example, it is the output of an MPEG 
decoirpression circuit that writes into system memory) , 
then it will be generally undesirable to apply the RGB- 

20 to-YUV transformation to such a region. On the other 
hand, if an adjacent portion of the same frame -buffer 
is RGB encoded, it will be generally desirable to apply 
the RGB-to-YUV transformation to this adjacent region. 
The sizes and locations of YUV and RGB pre- encoded 

25 regions can vary. The pixel-by-pixel control over the 
D-bit lets programmers turn conversion on and off as 
desired. 



Video D: 
11 


Lsplay Screen : 

7 


Cnfo Register ■ 
11 


- VDSI 

3 


HRES 


FRATE 


VRES 





HRES (11 bits) : Horizontal resolution. This is used as 

a CPU general storage area by which 
various software modules can define to 



BNSDOCtD <WO 963S037A1_1_> 



wo 96/36037 



PCTAJS96/06438 



- 53 - 

each other or determine the type of VPP 
processes being used. 
VRES (11 bits) : Vertical resolution. 

FRATE (7 bits) : Frame rate. Another CPU general -usage 
5 storage area. 

Video Display liOcation Register - VLOC 



11 


1 


11 


9 


HCOUNT 


FIELD 


VCOUNT 





HCOUNT (11 bits) : 

10 Horizontal pixel count after HSYNC (dve_vidHSOn) , 

Not implemented. 
FIELD (1 bit) : 

Field number. Indicates the odd/even nature of 
the current field that is being displayed. The 

15 field is odd (=1) if the HSYNC and VSYNC pulses 

are coincident. If the VSYNC pulse occurs in the 
middle of a line, the new field is even. ( = 0) 
VCOUNT (11 bits): 

Vertical line count after VSYNC (dve_vidVSOn) . 

20 The vertical line number after the start of a new 

field that is being displayed. Due to the 
asynchronous nature of the video clock, this 
value may be off from the actual line value by 1. 



Vertical Line Interrupt Register - VINT 



25 


1 


11 


1 


11 


8 




VINTO 


■VLINEO 


VINTl 


VLINEl 






VINTO (1 bi 


t) : 



Vertical Line Interrupt 0. This bit will get set 
when the video display has reached the vertical 
30 line number set in VLINEO, This bit being set 
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will cause the vid^busVertintO signal to be 
asserted for interrupting the CPU. To clear this 
bit, the CPU needs to write to the VINT- clear 
register with this bit set to 1. 
5 VLINEO (11 bits) : 

Vertical Line Number 0 . One of the two vertical 
line numbers where the video display unit should 
cause an interrupt. When the display reaches 
this line number, the VINTO bit will be set. 

10 VINTl (1 bit) : 

Vertical Line Interrupt 1. This bit will get set 
when the video display has reached the vertical 
line number set in VLINEl. This bit being set 
will cause the vid_busVertIntl signal to be 

15 asserted. To clear this bit, the CPU needs to 

write to VINT- clear register with this bit set to 
1. 

VLINEl (11 bits) : 

Vertical Line Number 1 . One of the two vertical 
20 line numbers where the video display unit should 

cause an interrupt. When the display reaches 
this line number, the VINTl bit will be set. 

Dither Matrix 0 - DMTO 



4 


4 


4 


4 


4 


4 


4 


4 


MTOO 


MTOl 


MT02 


MT03 


MTIO 


MTll 


MT12 


MT13 






Dither Mat 


.rix 1 


- DMTl 






II ^ 


4 


4 


4 


4 


4 


4 


4 


1 MT2 0 


MT21 


MT22 


MT23 


MT30 


MT31 


MT32 


MT33 



These two registers (DMTO and DMTl) store a set 
3 0 of dither matrix values that are downloaded into a 4x4 
dither matrix within dithering section 270. Each entry 
in the 4x4 matrix is a signed 4-bit value (in two's 
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complement form) . If dithering is enabled, a selected 
one of the signed values from the matrix will be added 
to each color component and wrap-around clipping will 
be performed. In ordered dithering the matrix entry to 
5 be used is determined by the less significant bits of 
the row and column number of the pixel being displayed. 
In random dithering the matrix entry to be used is 
picked pseudo- randomly. The DMTO register contains the 
MTOx and MTlx values, while the DMTl register contains 
10 the MT2x and MT3x values. Their placement within the 
4x4 matrix is shown in below TABLE- 8. 



TABLE- 8 





MTOO 


MTOl 


MT02 


MT03 




MTIO 


MTll 


MT12 


MT13 


15 


MT2 0 


MT21 


MT22 


MT23 




MT3 0 


MT31 


MT32 


MT33 



LFSR Seed Register - LFSR 

32 

LFSRSEED 

20 LFSRSEED (32 bits) ; 

Linear feedback shift register seed. When this 
register is written to, the contents are loaded 
into the LFSR within the dithering unit and used 
for pseudo- random number generation. 

25 DMA Snoop Control - DSNP 



1 


1 


2 


28 


FSN 


VSN 


FIFHP 





FSN (1 bit) : 

Frame Buffer FIFO DMA Snoop enable. 
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VSN (1 bit) : 

VDL DMA Snoop enable . 
FIFHP (2 bits) : 

FIFO high priority mark. This field determines 
5 when the FIFO is deemed near- empty and will 

change its memory request to high priority. The 
below TABLE- 9 shows the respective settings. 



TABLE -9 



FIFHP 


High priority level 


0 


if FIFO holds below 32 entries 


1 


if FIFO holds below 64 entries 


2 


if FIFO holds below 96 entries 


3 


Always 



The Active Video Display List (VDL) 

15 The forced VDL address registers mentioned 

earlier, FVOA and FVIA, cause the DMA engine within the 
VPP to begin fetching control words from a 
corresponding, active video display list for respective 
even and odd fields. 

20 Each active video display list (VDL) should 

contain a header of at least four mandatory words 
followed by an optional trailer. Each combination of 
mandatoiry header and optional trailer may point to 
another such combination or back to itself in linked- 

25 list style. 

A VDL entry has a format as shown in the below 
TABLE- 10. 
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TABLE- 10 


Frame 


buffer DMA control word (FB DMA) 


Frame 


buffer lower -line address (FB LL) 


Frame 


buffer upper- line address (FB UL) 


Pointer to next VDL entry (PA) 


Optional 


GLUT- download or video control word 


Optional 


GLUT- download or video control word 


*** 


*★* 


* * * 



The first mandatory word in the VDL entry header, 
is the frame buffer DMA control word. The structure of 
this control word is as follows: 

Frame buffer DMA control word (FB_DMA) 



15 


8 


1 


1 


1 


1 


1 


6 


9 


4 




MOD 


VDE 


PF 


UM 


LV 


uv 


NW 


NL 





MOD (8 bits) : 

Modulo value for next line address generation. 
If the LV bit is not set, the value contained in 

20 this field will be left-shifted 5 and added to 

the current lower- line data address to generate 
the next lower- line data address. This eighth 
bit field is shifted so that values from 32 to 
8160 (in increments of 32) may be used as the 

25 modulo value to add per the below TABLE- 11. 
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TABLE- 11 



Display type 


Modulo value to add 


Low resolution NTSC 32 -bit M2 


1280 


Low res. NTSC 16-bit M2 


o4 u 


Low res, NTSC 16 -bit LR Opera 


1280 


High res. NTSC 32 -bit M2 


2560 


High res. NTSC 16 -bit M2 


1280 


Low res, PAL 32 -bit M2 


1536 


Low res. PAL 16 -bit M2 


768 


Low res. PAL 16 -bit LR Opera 


1536 



VDE (1 bit) : 

Video DMA enable. This bit enables the fetching 
of frame buffer data into the FIFO and it 
indicates that the screen line is active. If VDE 
15 is logic "0", the DENC 160 keeps the horizontal- 

blanking (H-BLANK) for the indicated number of 
lines (NL) . No image data is fetched into the 
FIFO. The active video may thus be started any 
desired number of lines below the Vsync position 
20 and system bus time is not wasted on non- 

displayed data. 

PF (1 bit) : 

Physical address format. If this bit is set, the 
physical address in the fourth word of this VDL 
25 entry is a relative address. If this bit is not: 

set, the address is an absolute address - 
Upper scanline address -use modulo. If this bit 
is set, --and UV is false-- the next upper 
30 scanline address will be generated by adding the 

modulo value to the current upper line (UL) 
address. If this bit is not set, --and XJV is 
false-- the lower- line address will be used as 
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the next upper -line address. (In other words, 

the current lower scanline will become the upper 

scanline when the next line is being displayed. 

UL =LL T J . ) 
new old ' 

5 LV (1 bit) : 

Lower scanline data address validity. If this 
bit is set, the second word in this VDL entry 
will be loaded as the new lower scanline data 
address to . fetch from. Else a modulo value is 
10 added to the current address to generate the next 

lower- line (LL) address. 
UV (1 bit) : 

Upper scanline data address validity. If this 
bit is set, the third mandatory word in this VDL 
15 entry will be loaded as the new upper scanline 

data address to fetch from. Else the next upper 
scanline address will be generated per the 
setting of UM. 
NW (6 bits) : 

20 Number of words in this VDL entry. Since an 

optional number of control and GLUT data words 
may follow the four required words in the VDL 
header, this field defines the total number of 
words that are present in this VDL DMA. transfer. 

25 A value of zero is taken to mean that there are 

64 system memory words in this transfer. 
NL (9 bits) : 

Number of scan lines this VDL entry applies to. 
This value indicates the number of scanlines to 

30 wait before fetching and processing the next 

pointed- to VDL entry. A value of 0 means that 
this VDL entry applies to the remainder of this 
field no matter how many lines are left. The 
next VDL in such a case will be the forced VDL at 

3 5 the beginning of the next new field. 
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32 

FB LL Address 



32 



FB UL Address 



5 The second and third mandatory words in the VDL 

entry header contain 32 -bit wide absolute address 
values respectively pointing to the locations in system 
memory where the first lower scanline for this VDL 
entry resides and where the first upper scanline for 

10 this VDL entry resides. The respective upper and lower 
scanline addresses are loaded into the corresponding 
VPP control registers only if the corresponding valid 
bits LV and UV in the frame buffer DMA control word are 
set. If not set, the VPP increments its previous 

15 values as explained above. 

32 



Pointer Address (PA) 



The fourth mandatory word in the VDL entry header 
is a pointer address to the next VDL entry to be 

20 fetched and processed by the VPP when the nximber of 
lines (NL) of the current VDL entry are exhausted. The 
pointer address (PA) can be absolute or relative 
depending on the setting of the pointer- format (PF) bit 
in the frame buffer DMA control word (FB_DMA) . If the 

2 5 pointer address is a relative value, then the 
corresponding absolute address is calculated as 
follows : 

next VDL start address = current VDL start address + 4 + PA 

32 



30 



Optional CLUT- download or video control word 
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The optional fifth and further words of a given 
VDL entry can each be either a CLUT-update word or a 
video-display-path modifying control word. A control 
type code (CT) in each such optional word defines 
5 whether it is a CLUT-update word or a video- display- 
path modifying control word, and if so, what specific 
kind . 

CLUT update words may be used to modify the 
contents of the next CLUT 235. Video-display-path 

10 modifying control words may be used to modify the 
various parameters along the video display path, as 
shall become apparent below . 

There are at least five different kinds of CLUT 
update words as specified below. A first kind of CLUT 

15 update word writes all of its respective RGB values to 
the corresponding address in the next -CLUT 2 35. A 
second kind of CLUT update word writes only the 
contents of its BVALUE field to the corresponding 
address in the B sxib-CLUT portion of the next- CLUT 235. 

2 0 A third kind of CLUT update word writes only the 

contents of its GVALUE field to the corresponding 
address in the G sub-CLUT portion of the next-CLUT 235. 
A fourth kind of CLUT update word writes only the 
contents of its RVALUE field to the corresponding 
25 address in the R sub-CLUT portion of the next-CLUT 235. 
A fifth kind of CLUT update word writes all three of 
its RGB values to a corresponding background entry in 
the next-CLUT 235. The general format of a CLUT update 
word is as follows: 

3 0 CLUT Update Word 



II 


5 


8 


8 


8 


1 


CADDR 


RyALUE 


GVALUE 


BVALUE 



The fields in the CLUT update word are now detailed. 
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CT (3 bits) : 

This field defines the optional word type which 
can be a GLUT update word or a video display path 
control word. Up to eight different control code 
5 combinations may be used with this 3 -bit field, 

cO through c7. The following TABLE- 12 shows five 
such code combinations for specifying five 
different kinds of GLUT update words. 



TABLE- 12 



[ CT code 


Meaning 


cO 


Write all 3 RGB values into the 
addressed next -GLUT locations 


cl 


Write only the BVALUE 


c2 


Write only the GVALUE 


c3 


Write only the RVALUE 


C4 


Write all 3 RGB values into the 3 3rd 
background location of the next -GLUT 



CADDR (5 bits) : 

For GLUT update kinds cO through c3 this field 
specifies one of 32 entry positions in the next 
GLUT 235. For GLUT update kind c4 , the value is 
2 0 written into the 33rd background color entry of 

the next GLUT irrespective of this field. 
RVALUE (8 bits) : 

This is the mapped Red value (or Y value or 
generic A value) to be written into the 

2 5 corresponding R sub -GLUT portion of the next 

GLUT. 
GVALUE (8 bits) : 

This is the Green conversion value to be written 
into the corresponding G sub- GLUT portion of the 

3 0 next GLUT. 
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BVALUE (8 bits) : 

This is the Blue conversion value to be written 
into the corresponding B sub- GLUT portion of the 
next GLUT. 

5 Another type of optional CLUT/video control word 

is a so-called Video Display Control Word (VDCW) . The 
contents of this control word are loaded into either of 
VPP registers VDCO or VDCl in accordance with the 
setting of direction bit CN. 



10 



c5 



Video Display Control Word 

1 3 3 3 2 2 2 



CN 



HS 



VS 



BS 



HIE 



VIE 



FE 



VDCW) 



2 



DE 



MBE 



15 



20 



25 



30 



When the control type code is CT=c5, the optional 
control word may be used to set the following control 
parameters in a designated one of the VDCO and VDCl 
registers . 
CN (1 bits) : 

Control register n\amber. The control signals 
specified in the rest of this optional word are 
loaded into one of two control registers (VDCO or 
VDCl) identified by this bit. The D-bit in the 
pixel data then drives a multiplexer (part of 
which is shown as 435 in Fig. 4A) that selects 
the output of one of the two control registers 
(VDCO or VDCl) for then controlling at least the 
following functions of the video display path: 
HS, VS, BS, HIE, VIE, FE , DE , and MBE. 
(3 bits) : 

H subposition-bit select- Select source of H bit 
for Opera style interpolation per TABLE- 13. 
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TABLE- 13 



HS 


Meaning 


0 


Use D-bit 


1 


Use Blue Pen Bth msb 


2 


Set to 0 


3 


Set to 1 


4 


Keep previous setting of HS field for this 
VDC 0/1 register 



VS (3 bits) : 

V subposition-bit select. Select source of V bit 
10 for Opera style interpolation per TABLE- 14. 

TABLE- 14 



VS 


Meaning 


0 


Use D-bit 


1 


Use Blue Pen 5th msb 


2 


Set to 0 


3 


Set to 1 


4 


Keep previous setting of VS field for this 
VDC 0/1 register 


(3 bits) : 



Blue bit select. Select source of the blue PEN'S 
2 0 5th msb per below TABLE- 15. 

TABLE- 15 



B5 


Meaning 


0 


Use Blue Pen 5th msb 


1 


Use Green Pen 5th msb 


2 


Set to 0 


3 


Set to 1 


4 


Keep previous setting of BS field for this 
VDC 0/1 register 
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For the following 2 -bit wide control signals, 
HIE, VIE, FE, DE, MBE the following encoding of 
TABLE- 16 is used: 

TABLE- 16 



Signal 


Meaning 


0 


Disable 


1 


Enable 


2 


Keep previous setting of this field for 
this VDC 0/1 register 



HIE 


(2 bits) : 


VIE 


12 bits) : 


FE 


(2 bits) : 


DE 


(2 bits) : 


MBE 


(2 bits) : 


If the 



Horizontal interpolation enable. 
Vertical interpolation enable. 
Filter enable. 
Dither enable. 
Matrix bypass enable. 

15 If the control type code CT of an optional 

CLUT/video update word is equal to a seventh code, c6, 
the control word functions as an Active Video Display 
Word (AVDW) . This controls display path functions such 
as horizontal and vertical pixel doubling. 



20 



3 


11 


1 


11 


1 


1 


1 


1 


1 


1 


C6 


HSTART 


HSTL 


HWIDTH 


HWL 


HPD 


VPD 


HPDL 


VPDli 





25 



30 



HSTART (11 bits) : 
HWIDTH (11 bits) : 



start 



of 



active 



Horizontal 
pixels . 

Horizontal width screen line in 
terms of active pixels. 

HPD (1 bit) : 

Horizontal pixel doubling. When this bit is 
at logic "1", two active horizontal video 
pixels will be generated for each frame- 
buffer pixel . This bit determines how fast 
pixel data is read out from the FIFO (one or 
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two frame-buffer pixels per screen pixel) . 
All applications using Opera style 
interpolation need to fetch two 
horizontally- adjacent pixels from the frame - 
5 buffer and pass them through the GLUT 

associated with their line (LL or UL) for 
every produced screen pixel so that, when 
horizontal interpolation is optionally 
turned on (by way of HIE) , two CLUT-mapped 
10 horizontally- adjacent pixels may be 

simultaneously presented to the interpolator 
250 for interpolation. 
VPD (1 bit) : 

Vertical pixel doubling. varhen this bit is 
15 at logic "1", two vertically -adjacent active 

video lines will be produced for each frame - 
buffer line. All applications using Opera 
style interpolation need to be able to 
produce 2 active vertical video lines for 
20 every frame buffer line. Having this bit 

set implies that vertical interpolation can 
be turned on (by way of VIE) and two 
vertically adjacent pixels from the system 
memory frame-buffer have to be fetched and 
25 passed through respective upper and lower 

GLUT'S for each screen pixel that is to be 
displayed on the VDU screen. 
HSTL (1 bit) : 

HSTART load. If this bit is set, the value 
3 0 in the HSTART field is loaded into the 

corresponding control register. Else the 
previous value is kept. 
HWL (1 bit) : 

HWIDTH load. If this bit is set, the value 
35 in HWIDTH is loaded into the corresponding 
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control register. Else the previous value 

is kept. 
HPDL (1 bit) : 

HPD load. If this bit is set, the value in 
5 the HPD field is loaded into the 

corresponding control register. Else the 

previous value is kept . 
VPDL (1 bit) : 



10 



VPD load. If this bit is set, the value in 
the VPD field is loaded into the 
corresponding control register. Else the 
previous value is kept . 
When the control type CT is equal to a eighth 
code, c7 , the optional word functions as a Video 
15 Display List Control "Word (VDIjCW) having the following 
structure : 



Video Display List Control Word (VDLCW) -Part 1 



3 


1 


1 


2 


2 


1 


1 


1 


1 


X 




C7 


CLUT 


RGB 


CBP 


FB 


FILT 


FTRAN 


BKG 


V 


R 






BP 




SEL 


FORMAT 


TYPE 




TRAN 


I 


D 




















L 


M 





20 



Video Display List Control Word (VDLCW) -Part 2 





1 


1 


1 


i 


1 


1 


1 


11 




CLUT 
BPL 


RGB 
L 


CBP 
SEL 
L 


FB 
FORMAT 
L 


FILT 
TYPE 
L 


FTRAN 
L 


BKG 
TRAN 
L 





25 



The fields are as follows: 

CLUTBP (1 bit) : 

CLUT bypass enable. If this bit is set, the 
soft CLUT's will be bypassed whenever the 
D-bit in the pixel data is set. 

RGB (1 bit) : 

RGB Mode, Display output format is RGB (=1, 
disable matrix convert) or YUV (=0) , 
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CBPSEL (1 bit) : 

GLUT bypass select. When the GLUT'S are 
bypassed, the three least 
significant bits of each 8 -bit 
color code color may come from 
four sources. The sources and 
encoding is specified in the 
following TABLE- 17: 



TABLE- 17 



CBPSEXi 


Meaning 


0 


Fill with O's 


1 


Fill with 3 msb's from FIFO output 


2 


Fill with O's 


3 


Fill with 3 iBh's from FIFO output 



15 FBFORMAT (2 bits) : 

Frame buffer format. The video display path 
can handle three different frame buffer 
formats. The formats are encoded as shown 
in below TABLE-18: 



20 TABLE-18 



FBFORMAT 


Meaning 


0 


16 -bit Opera LR format 


1 


N/A 


2 


16 -bit M2 format 


3 


32 -bit M2 format 



FILTTYPE (1 bit) : 

Filter type. Selects either the full 
resolution (=1) or quarter resolution filter 
(=0) . 
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FTRAN (1 bit) : 

Force transparency. If this bit is set, the 
transparency signal sent to the digital 
encoder will be forced to one for the entire 
5 line. 

BKGTRAN (1 bit) : 

Background transparency- If this bit is 
set, the transparency signal sent to the 
digital encoder will be asserted whenever a 
10 background pixel is detected. 

VIL (1 bit) : 

Vertical interpolation line. If this bit is 
set, vertical interpolation for the first 
scanline associated with this VDL will be 
15 turned off. The remaining lines associated 

with this VDL will have vertical 
interpolation enabled depending on the D-bit 
and VIE- 0/1- 

RDM (1 bit) : 

20 Random dither matrix index. If this bit is 

set, a LFSR seed will be used to randomly 
select which matrix entry to use. If this 
bit is clear, the row and column position of 
the pixel within the active display area 

25 will be used to index into the dither 

matrix. 
CLUTBPLd bit) : 

CLUTBP load. If this bit is set, load the 
CLUTBP data into the corresponding control 

30 register, else keep previous value. 

RGBL (1 bit) : 

RGB load. If this bit is set, load the RGB 
data into the corresponding control 
register, else keep previous value. 



BNSDOCID: <WO 9636037A1_L> 



wo 96/36037 



PCTAJS96/06438 



- 70 - 

rBPSEi.L (1 bit) : 

CBPSEL load- If this bit is set, load the 
CBPSEL data, else keep previous value. 

FBFORMATL (1 bit) : 
5 FBFORMAT load. If this bit is set, load the 

FBFORMAT data, else keep previous value. 

FIIiTYPEL (1 bit) : 

FILTTYPE load. If this bit is set, load the 
FILTTYPE data, else keep previous value. 

10 FTRANL (1 bit) : 

FTRAN load. If this bit is set, load the 
FTRAN data, else keep previous value. 
BKGTRANL (1 bit) : 

BKGTRAN load. If this bit is set, load the 

15 BKGTRAN data, else keep previous value. 

The ci)ove disclosure is to be taken as 
illustrative of the invention, not as limiting its 
scope or spirit. Numerous modifications and variations 
will become apparent to those skilled in the art after 

20 studying the above disclosure. For example, the 
invention is not restricted to RGB formats. Other 
digital formats such as YCC, or Composite Video 
Broadcast Standard (CVBS) , can also be used. For the 
sake of simplification, an RGB format was assumed 

25 above. 

Given the above disclosure of general concepts 
and specific embodiments, the scope of protection 
sought is to be defined by the claims appended hereto. 
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CLAIMS 

What is claimed is: 

[Note: Bracketed bold and italicized 
text is provided in the below claims as an 
aid for readability and for finding 
corresponding support in the specification. 
The bracketed text is not intended to add 
any limitation whatsoever to the claims and 
should be deleted in all legal 
interpretations of the claims and should 
also be deleted from the final published 
version of the claims.] 

1. A configurable imaging system comprising: 

(a) system memory means 1130-1311 for storing 
data including first data 1140/141} defining pixels of 
a frame-buffer and second data [142/143} defining 

5 display control parameters; 

(b) video post -processor means [150] , coupled to 
the system memory means and responsive to the display 
control parameters defined by said second data 
1142/143} , the video post -processor means including: 

LO (b.l) first control register means IVDCO-BSO} for 

storing a first setting of control parameters; 

(b.2) second control register means IVDCl-BSl} 
for storing a second setting of control parameters; 

(b.3) selection means 1435} responsive to a 
15 modulating signal [D-bit] that is variable on a pixel - 
by-pixel basis, said selection means being for 
selecting one of the first and second control register 
means [VDCO/VDCl} as the control register currently 
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defining controllable parameters of the video post- 
processor means [150] • 
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